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Recently, we reported that vaccinating mice with a live attenu- 
ated influenza vaccine (LAIV) led to substantial increases in 
the dynamics of nasal colonization by important and common 
bacterial respiratory pathogens, including Streptococcus pneu- 
moniae and Staphylococcus aureus (1). However, as Coelingh and 
Belshe point out (2) and as we emphasize both in that paper and 
again here, in contrast to what occurred when mice were vacci- 
nated against seasonal influenza viruses, mice vaccinated with 
LAIV did not exhibit increased susceptibility to bacterial disease in 
the lower respiratory tract, which is of particular concern when 
considering what is known about interactions between influenza 
viruses and bacterial pathogens (3). 

Our investigation received considerable attention, but unfor- 
tunately, a large portion of it came from the antivaccine move- 
ment. This is not surprising, as our results — the first to demon- 
strate an increased level of one pathogen as a result of a vaccine 
targeted against an unrelated pathogen — can easily, perhaps in- 
tentionally, be misinterpreted to seem as though our data advo- 
cate against the use of live attenuated influenza vaccines. This is 
not the case, and we agree firmly with the overwhelming data 
demonstrating that both LAIV and inactivated influenza vaccines 
are beneficial in reducing influenza-related disease (4), including 
from bacterial infections (5, 6). What we demonstrated in our 
report ( 1 ) is that an LAIV induced excess replication of multiple 
bacterial pathogens in the upper respiratory tracts of mice without 
causing consequent lower respiratory tract disease. 

What do the clinical data show? Citing the abstract (7) of a 
randomized placebo-controlled study of LAIV (n = 151 children) 
by Thors et al. submitted for presentation at the 2014 Interna- 
tional Symposium on Pneumococci and Pneumococcal Disease 
(ISPPD) in Hyderabad, India, Coelingh and Belshe state that there 
is no clinical association of LAIV with nasal carriage of bacteria in 
humans. Based on the initially submitted (and therefore pub- 
lished) abstract detailing the preliminary results of that study, 
Coelingh and Belshe were correct in their assertion that LAIV was 
not associated with increased bacterial titers in that study. How- 
ever, the updated analysis of the results of that trial, which was 
ultimately presented at the ISPDD in March of 2014 under a title 
(8) different from that of the published abstract, suggests that the 
Ann Arbor strain LAIV licensed for use does significantly increase 
bacterial carriage density. 

In the updated and presented analysis, Thors et al. found that 
the average pneumococcal bacterial density detected in the naso- 
pharyngeal samples of the 151 children was increased by 59% at 
7 days postvaccination (P = 0.16) and by 200% at 28 days post- 
vaccination (P = 0.08). This analysis compared average bacterial 
titers (negative samples were excluded) measured over the whole 



cohort of 1 5 1 vaccinated children at days 7 and 28 postvaccination 
to prevaccination titers. While this analysis provides some insight, 
a more appropriate analysis to determine effects of LAIV on bac- 
terial density would be to assess changes at the individual level and 
only in those children colonized at baseline (i.e., at the time of 
vaccination). Indeed, Thors et al. performed this analysis using 
paired data. Among the 96 children colonized at baseline, vacci- 
nation with LAIV increased the bacterial carriage density within 
an individual, on average, by approximately 1.5-fold (51%; P = 
0.10) and -216% (P = 0.025) at days 7 and 28 postvaccination, 
compared to carriage at day 0. Although statistically significant 
increases (at an alpha of 0.05) were not detected at day 7 versus 
baseline, as we demonstrate in our recommendations below, this 
study may have been underpowered to detect a 1 .5-fold increase in 
pneumococcal density. 

While we cannot attest to the reasons for the discrepancies 
between the initial published abstract (7) cited by Coelingh and 
Belshe and their updated work presented at the meeting (8), the 
updated analysis by Thors et al. and the discrepancies noted high- 
light both the need for further investigations and the requirement 
for multiple investigations before unanimous assertions can be 
made. 

As we pointed out in our initial paper (1) and as Thors et al. 
concluded in their presented work, the effects of LAIV on bacterial 
carriage dynamics in humans should be evaluated using larger 
sample sizes that are better able to detect differences in bacterial 
carriage density, particularly given the large variance in titers de- 
tected. 

As baseline colonization rates will be different between study 
sites, sample size calculations must account for the prevalence of 
colonization and expected variance in bacterial titers, and a con- 
servative threshold should be used for clinically or ecologically 
relevant changes in bacterial density. Given these and other com- 
plexities and assumptions (e.g., correlated-data structures), such 
sample size calculations can be difficult to obtain by traditional 
methods attempting to find a closed-form solution. Using a 
stochastic-simulation approach, with variance in carriage density 
parameterized by data previously collected in our lab from 345 
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FIG 1 Power and sample size calculations for studies evaluating effects of 
LAIV on bacterial densities. Ten thousand stochastic simulations were run for 
each potential sample size interrogated (indicated by filled circles in panels A 
and C) and for each minimum-effect size (1.5-fold and 2.0-fold), totaling 
300,000 unique simulated trials. Variation in simulated bacterial densities was 
parameterized from data previously collected by our lab from a series of 345 
pneumococcus-positive nasal swabs (9). Each series of 10,000 simulations 
comprised 10 distinct sets of 1,000 unique simulated trials, and each of the 
trials was tested for statistically significant differences in bacterial titers when 
data were stochastically simulated for 1.5-fold-increased (A, B) and 2-fold- 
increased (C, D) bacterial titers from baseline for each individual. Within each 
of the 10 distinct sets of 1,000 trials, the proportion of trials for which P values 
were <0.05 (i.e., the power to reject the null hypothesis when the alternative 
hypothesis is true) was recorded, and the mean of the values from the 10 
distinct sets is plotted for each sample size tested (A, C). Because baseline 
prevalences of pneumococcal carriage will differ between study sites, the final 
number needed to enroll is plotted against increasing baseline prevalence for 
powers of 0.8 and 0.9 to detect minimum-effect sizes (i.e., increases in bacterial 
titers from baseline) of 1.5-fold (C) and 2-fold (D). CI, confidence interval. 

pneumococcal nasopharyngeal samples (9), we devised and pro- 
vide here (Fig. 1) recommendations for sample sizes sufficient to 
evaluate effects of LAIV on bacterial carriage density. In particu- 
lar, we provide sample sizes required to detect 1.5-fold changes 
(50% increases) and 2-fold changes (100% increases) in bacterial 
density from baseline density, which we feel represent the lower 
end of what may be clinically relevant, particularly with regard to 
potential for increased transmission (10; see below). 

We detect, for example, a minimum sample size of 92 to 
achieve 80% power to detect a 2-fold (100%) increase in bacterial 
density, given a 60% baseline prevalence of pneumococcal car- 
riage (Fig. 1A and B), which is approximately the baseline preva- 
lence for the data presented by Thors et al. ( 8 ) ( 96/ 1 5 1 ) and which 
suggests that the study was well designed to detect a 100% in- 
crease. Figure 1 also demonstrates that the lack of statistical sig- 
nificance in the 50%-increased density (P = 0.10) 7 days after 
LAIV administration reported by Thors et al. was possibly due to 
insufficient power to detect only a 1.5-fold increase in bacterial 
titers, rather than a spurious increase that occurred purely by 
chance (i.e., the sample size required to achieve 80% power to 
detect a 50% increase given a baseline prevalence of 64% is 340, 
over twice the sample size of their study). 



These nontrivial power calculations should aid in future inves- 
tigations by providing a guideline to ensure that studies evaluating 
effects of LAIV on bacterial densities using individual-level data 
are not underpowered. 

Besides enrolling appropriate sample sizes, future investiga- 
tions should also consider appropriate sampling intervals when 
allocating resources. For example, the mouse data reported by us 
suggest that the time of greatest increased bacterial titers following 
LAIV (and wild-type virus) administration occurs over a period of 
days, not weeks. In mice, this excess occurs primarily between days 
4 and 12 after LAIV administration (1, 5), but the same timeline 
cannot be assumed for humans. Indeed, Thors et al. found greater 
increases in bacterial titers at 28 days (225%) than at 7 days (50%) 
postvaccination. However, given the lack of sampling within this 
interval, which spans 3 weeks, a much larger increase in bacterial 
density may have been missed, in which case, these two samples 
might represent just the tails of an increased density curve. Thus, 
an ideal study with unlimited resources and very patient children 
might sample, at a minimum, at days 0, 7, 14, 21, 28, and 35 after 
LAIV administration. 

This basic study design could be enhanced significantly to si- 
multaneously address effects of LAIV on bacterial acquisition (a 
common consequence of wild-type influenza virus infections 
(11). This can most easily be achieved by separating participants 
into two study arms, with vaccination between the two arms stag- 
gered at least 35 (but preferably more) days apart. Sampling in the 
lagging arm prior to vaccination should then occur at the same 
intervals as in the initially vaccinated arm postvaccination. In this 
design, comparing bacterial acquisition rates between the two 
arms during the initial 35 days (i.e., one arm receiving LAIV at day 
0 and the other arm receiving the vaccine at day 35) can assess 
whether differences in bacterial acquisition between LAIV- 
administered subjects and contemporaneous controls exist. Note 
that in this design, analysis methods must consider correlated data 
(i.e., at the individual or household levels) . Analyses of acquisition 
can be enhanced considerably further by determination of pneu- 
mococcal capsular serotypes, and serotype-specific data will en- 
able detection of interactions between specific serotypes and ef- 
fects of LAIV on bacterial densities. 

As Coelingh and Belshe point out, LAIV has been proven to be 
safe and effective in numerous trials enrolling tens of thousands of 
children and even adults. However, given the strong emphasis of 
vaccine research on individual recipients, no trial has assessed the 
potential impacts of immunization on contacts of vaccine recipi- 
ents with regard to a pathogen that is distinct from the vaccine 
target pathogen. We agree that the LAIV is safe and highly effective 
at the individual vaccine level, even when altered bacterial carriage 
densities are considered. Indeed, even within our highly con- 
trolled mouse system, increased carriage density following LAIV 
administration was not associated with increased lower respira- 
tory tract disease and may have even reduced severe bacterial dis- 
ease ( 1 ) . However, bacterial carriage begets bacterial transmission, 
and even relatively small increases in bacterial carriage density 
may increase bacterial transmission to bystander individuals (10, 
12), a finding that has been shown in numerous mouse and ferret 
models of pneumococcal transmission (10, 13), as well as in stud- 
ies looking at transmission of other pathogens (14, 15). 

In the context of LAIV, one could envision a situation whereby 
a vaccinated individual with elevated bacterial carriage titers may 
not himself or herself be susceptible to bacterial disease but in- 



2 mBio' mbio.asm.org 



May/June 2014 Volume 5 Issue 3 e01173-14 



Author Reply 



stead may act as a reservoir for increased transmission. Such a 
scenario might be particularly important, for example, between 
young children and grandparents or other elder individuals al- 
ready having increased susceptibility to pneumococcal disease 
(12). Additionally, although LAIV is not recommended for im- 
munocompromised individuals, an unintended LAIV effect of in- 
creased bacterial transmission might have an important impact on 
bacterial disease in immunocompromised contacts. 

Studies aiming to determine bacterial transmission among hu- 
mans are difficult and expensive to perform, requiring longitudi- 
nal sampling of contacts surrounding, in this case, the LAIV- 
administered individual. While bacterial-transmission studies are 
not without precedent (16, 17), they always require large resources 
and extensive sampling efforts. Given the immense resources re- 
quired to properly assess transmission level effects, it is reasonable 
to hold off on such large studies. However, further evidence of 
increased bacterial density within the nasopharynx as a conse- 
quence of LAIV administration in humans will indicate the need 
for these types of studies in order to fully understand unintended 
consequences of LAIV administration on bacterial-pathogen dy- 
namics. 

The findings put forth in our initial report for mice ( 1 ) bring to 
light an important topic that should be further evaluated for live 
influenza vaccines and should lead to additional consideration of 
the broader aims of vaccine-monitoring programs. Current vac- 
cine safety programs aim to ensure protection at the individual 
level, in particular, to confirm that vaccination causes no en- 
hanced susceptibility to the pathogens targeted by vaccination and 
that vaccination has no immunologically relevant adverse events. 
Given the increased awareness of, and ability to understand, mul- 
tispecies pathogen interactions within the host (which are often 
mediated by host immune processes), it is incumbent upon us to 
consider not only individual-level pathogen-specific vaccine 
safety and efficacy but also unintended consequences of vaccines 
on the dynamics of unrelated pathogens. While this task is daunt- 
ing, the signals to be investigated can be narrowed significantly by 
focusing on species already known to interact with the naturally 
circulating pathogen to be vaccinated against. For example, there 
is perhaps no better-understood multispecies pathogen interac- 
tion than that among influenza viruses, pneumococcal bacteria, 
and the human or animal host. Thus, to determine if a live atten- 
uated influenza vaccine was able to impact a pathogen that is un- 
related to the targeted influenza virus, we simply started with the 
pathogen most known to interact with naturally circulating influ- 
enza viruses, i.e., the pneumococcus ( 1 ) . After the pneumococcus, 
we then looked at what else has been shown in the literature to 
interact with influenza virus, namely, Staphylococcus aureus. By 
looking at these interactions in mice, we were able to quickly iden- 
tify two interactions that can be and, as described above, are being 
directly evaluated in humans. 

The Vaccine Adverse Event Reporting System (VAERS) was set 
up to monitor postlicensure and postmarketing safety of vaccines 
and emphasizes sensitivity over specificity to catch unintended 
and rare events that may occur at the level of the vaccinated indi- 
vidual but that may have gone undetected in premarketing trials 
(18). Systems such as VAERS are effective tools to detect any num- 
ber of adverse conditions within a vaccinated individual, be they 
from adverse immunologic responses, increased incidence of in- 
fection, or even potential secondary infections (18). However, by 
focusing on the individual, most prelicensure and pre- and post- 



marketing studies and monitoring systems do not detect potential 
adverse or unintended effects of vaccines that may (i) be subclin- 
ical (e.g., increased carriage density without disease) or (ii) occur 
as a result of increased transmission of the vaccine target pathogen 
to unvaccinated individuals, much less a pathogen that is phylo- 
genetically distinct from the vaccine target. Thus, such effects 
would go entirely undetected unless specifically analyzed. Further, 
if seasonality of the second pathogen coincides with a rollout of 
vaccination, as is the case with annual influenza vaccinations and 
the seasonality of pneumococcal disease, special care is required to 
account for this seasonality of the secondary pathogen so that a 
potential signal is not lost. 

We recognize that this is a new field; indeed, our study is 
among the very first to suggest the existence of cross-species effects 
of vaccination on unrelated pathogens. Nevertheless, as we prog- 
ress into this new millennium, vaccine programs will increase in 
both size and scope in order to ensure the right to health and 
wellbeing of all individuals. The growth in these programs must 
inspire and be equally met by new methods and technological 
innovations able to ensure that the highest standards of vaccine 
safety and effectiveness are maintained across the all spectrums of 
potential effects (19). By all metrics, vaccines are among our most 
successful and effective tools to prevent disease by infectious 
pathogens, so let us ensure that our tools to assess them continue 
to be equally robust and effective. 
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